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1  INTRODUCTION 

We  consider  the  problem  of  estimating  the  location  vector  x  and  velocity  vector  v  of  a 
remote  target,  as  viewed  through  an  optical  system.  The  focal  plane  consists  of  a  large  array 

of  CCD  photo-detectors.  The  amount  of  charge  stored  in  a  CCD  cell,  after  an  appropriate 
exposure  time,  is  the  sum  of  two  independent  Poisson  random  variables:  one  due  to  the 
target  signal,  the  other  due  to  noise.  Therefore  both  the  signal  and  the  noise  are  “random” 
quantities. 

Many  applications  require  knowledge  of  the  inherent  maximum  estimation  accuracy. 
The  classical  Cram4r-Rao  lower  bound  [1,2]  has  been  widely  used  for  this  purpose.  Using 
Poisson  statistics,  Wlnick  in  a  recent  paper  [3]  has  derived  the  Cram4r-Rao  location  bounds 
for  a  stationary  target  on  a  two-dimensional  CCD  focal  plane.1  In  this  report  we  Investigate 
the  bounds  when  the  target  Is  nonstationary  during  the  time  of  exposure.  As  a  result  of  the 
target  motion,  the  image  observed  on  the  focal  plane  is  elongated  along  the  velocity  vector. 

In  this  section  we  discuss  a  Gaussian-shaped  signal  model,  and  in  the  next  section  we 
will  derive  the  Cram4r-Rao  location  and  velocity  bounds  based  on  this  model.  We  use  a 
two-dimensional  Dirac  delta  function  6  fa  -  jjt)  to  represent  a  rectilinearly  moving  point 
source,  with  a,  and  a  denoting  the  position  and  the  velocity  of  the  target  and  t  denoting  the 
time.  The  image  of  the  target  Is  projected  uj  m  a  CCD  focal  plane  through  an  ordinary 
telescope.  Let  3mnfa})L)  be  the  m-nth  sample  of  the  optical  image,  then  the  relationship 
between  6fa,pf)  and  smn(lill)  can  be  described  by  linear  system  as  shown  in  Fig.  1. 

Several  functions  are  Involved  in  this  system.  They  are  the  point-spread  function  pfa ), 
‘A  brief  survey  of  previously  published  work  can  be  found  in  Winick'i  paper  [3]. 
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the  dimension  function  of  the  CCD  cell  gmn(£),  and  the  frame  integration  function  <7(0* 


For  the  point-spread  function  we  use  a  Gaussian  approximation  [4] 

1 


pU)  = 


y/2nc„ 


exp 


xx 


(1) 


where  is  the  standard  deviation  of  the  Gaussian  function  and  the  prime  denotes  the 
transposition  operation  that  converts  the  column  vector  into  a  row  vector. 

The  CCD  ceils  and  the  temporal  integration  usually  have  well  defined  boundaries. 
Therefore  they  should  be  modeled  by  a  rectangular  function.  Unfortunately  bounds  de¬ 
rived  from  such  functions  contain  integrals  which  do  not  have  closed  form  representations. 
Since  a  major  goal  of  thin  work  is  to  derive  analytic  Cram4r-Rao  bounds  for  a  special  case 
that  is  not  overly  restrictive,  so  that  we  can  infer  some  useful  properties  of  the  bounds,  we 
will  approximate  both  gmn(l)  and  g(t)  by  Gaussian  functions.  They  are  given  by 

1 


9mn(3t) 


and 


\Wr0o 


9{  0 


exp 


1 


2  o\ 


(2) 


exp 


f* 

'2fff 


(3) 


In  (2)  and  (3),  <r0  is  the  radius  of  a  circular  area  used  to  approximate  the  square  CCD  cell 
area,  and  <7t  is  a  time  parameter  used  to  approximate  half  the  frame  integration  time. 

The  signal  function  smn(aLi3l),  seen  by  the  m-n th  CCD  cell  may  be  obtained  by  mul¬ 
tiplying  the  Fourier  transforms  of  the  four  functions  and  then  taking  the  inverse  Fourier 
transform.  The  result  is 


«mn(aL,li)  *  A  exp 


(jL  ~  —  Imn) 

exp 

'Ml-fasMl-Imn)  {* 

i\i 

r  **  J 

2  crj  +  u'll*?  \< 

(4) 
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with  a]  =  a]+a],  In  (4)  we  have  used  a  scaling  factor  A.  If  we  require  that  ■smn(x,£)  = 
1  then  A  is  given  by 

,1  =  - .  (5) 

A  typical  signal  image  is  shown  in  Fig.  2.  Note  that  the  signal  has  wide  spread  in  the 
direction  of  the  velocity  vector  and  relatively  narrow  spread  in  the  perpendicular  direction. 

Generally  Eq.  (4)  is  not  a  separable  function  except  when  the  target  moves  parallel  to 
one  of  the  coordinate  axes.  Because  this  simplification  allows  us  to  gain  some  insight  into 
the  Cram6r-Rao  bounds  we  will  formulate  the  signal  for  this  special  case.  Let  £  =  [*i,xa]i 
£mn  =  H  =  [vi,va].  Letting  V'i  as  0  Eq.  (4)  reduces  to  a  separable  function 


5mn(*U®3»t>l)  sa  P\(X\  -  Pa(® j  -  ®jn) 


(6) 


with  P\  and  Pa  given  by 


A(®1  -  ®lm,t>l)  =  “7 


and 


Pa(®a  -  ®an)  =  -t*  exp 


exp 


(®'t  ~*  ®lm)^ 

2  (or?  +  v]af) 


(®2  ~  ®2n)‘ 

2a] 


(7) 


(3) 


Eq.  (6)  will  be  used  in  the  next  section  for  the  derivation  of  the  analytical  forms  of  the 
Cram4r-Rao  bounds  for  the  special  case  of  1/3  »  0. 


2  THE  CRAMER- RAO  BOUNDS 

In  this  section  the  Cram4r-Rao  bounds  for  the  estimation  of  locatiou  and  velocity 
are  derived.  We  model  the  electronic  signal  (the  electron  count)  rmn(£,]i)  to  be  the  sum 
of  three  independent  Poisson  processes  —  the  photoelectrons  produced  by  the  target,  the 
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photoelectrons  produced  because  of  the  sky  background  noise,  and  the  electrons  produced 
by  CCD  dark-current  during  frame  integration  time.2  The  rmn(£,  v)  itself  is  therefore  a 
Poisson  process3  with  the  average  number  of  electrons  given  by  A,sm,i(x,  v)  +  Ajv  where  A, 

is  the  average  number  of  photoelectrons  produced  by  a  target  of  unit  intensity,  and  A/v  is 
the  average  number  of  photoelectrons  produced  by  the  sum  of  the  two  noise  processes.  The 
noise  is  assumed  to  be  spatially  and  temporally  independent  and  stationary. 

If  Pmn  the  observed  number  of  electrons,  the  likelihood  ratio  A  can  be  written  as 

A-nm,n  J-  j  e  .  (9) 

Taking  logarithm  of  both  sides,  we  get  the  log  Likelihood  ratio 

InA  a  52rmrtln  (l  +  -  51  A,amn  .  (10) 

mn  '  /  mn 

If  we  assume  the  stressing  case  where  the  target  intensity  is  much  less  than  the  noise,  that 
is,  Af 3„|7|  A^v,  ^  then 

h(l+^)aAfe.  (U) 

Substituting  (11)  into  (10)  yields 

in  A  ~  t—  /^(r*nn  “  ^A^)l*mr»  •  (12) 

A'v  mn 

Eq.  (12)  provides  us  with  a  formula  for  the  matched  Alter  detection  of  the  target  streak. 

aThe  readout  circuitry  noise  is  assumed  to  be  email,  and  not  tha  limiting  factor  of  performance. 

3 Due  to  the  reproductive  property  of  the  Poisson  distribution. 

‘The  bound*  derived  under  this  sseumption  will  likely  to  be  too  pessimistic  when  the  signal  lntanalty  is 
high. 
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The  Cram4r-Rao  bounds  are  the  diagonal  elements  of  the  inverse  of  the  Fisher  informa¬ 


tion  matrix 


T  =  [Ail 


where  the  i-jt/i  element  of  T  is  defined  as 


/a  =  E 


01nA  5  In  A 
Qdi  09, 


The  (9’s  are  defined  as  0\  =  as  ij,  $3  avj,  and  9\  =  V3.  Therefore,  for  example,  the 
variance  of  the  x\  estimate,  denoted  by  cr^,  satisfies  the  relationship  o^,  >  If  fa. 

Taking  the  derivative  of  (12)  we  obtain 


0  In  A  A  j  .  ,ds 


dOi  ' 


The  fij  are  then  rewritten  as 


Ui  "  fe(r —  ~ Ajv)^. 


Letting  rmn  =  Smn  -I-  iVm„,  where  5mn  and  iVmn  are  Independent  signal  and  noise 
processes,  then  the  correlation  £[(rmn  -  Aiv)(rp,  -  A,v)]  can  be  evaluated  as 

£[(rmn  —  Aiv)(r"p7  —  A  w )]  “  ^[(•S'mn  +  Nmn  —  A/v)(5P7  +  Npq  —  A/v )] 

=  EiSmnSp,}  +  £[$  ]  -  A^£[5  mn  ]  +  E[SpqNmn] 

“  XffE[Nmn]  —  A/vi5[‘5'Pg]  —  A/v£[iV p9]  -f  A^ 
■  AjsmnsM  +  (A,jTOn  +  A/v)^(m-p,n-g)  .  (17) 


Substituting  (17)  Into  (18)  yields 
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(18) 


,  Ai}  fOsmn  \  ( dspq  \  ,  X]  ^  ( dsmn  dsmn  _ 

f“  =  AJ7 1  VW1'")  jf  {  Mi3”")  +  Kh\  «<  Mi  Sm” 

4  AL  v  ( d3mn  da  mn\ 

M  Mi  )  ' 

The  Fisher  information  matrix,  whose  elements  are  given  by  (18),  usually  requires  nu¬ 
merical  computation.  However,  considerable  simplification  is  possible  when  the  signal  is 
treated  as  a  continuous  signal  (not  sampled)  and  when  its  velocity  is  aligned  with  one  of 
the  axes,  owing  to  the  fact  that  the  signal  becomes  separable.  For  this  special  case  the 
Cramer-Rao  brands  are  found  to  be8 


a 


2 


a 


2 

*2 


<T 


2 


> 

> 

> 


(<r?  +  v?<r?) 


4SNR3 

9Aj 


[4SNRa 
'  9A, 

,  SNR' 

+  "T 


+ 


) 


SNR' 

2 


1 


+  v3<r3 
- 

Vl°'t 


3SNR' 
4  . 


(19) 

(20) 
(21) 


The  SNR  is  the  signal-to-noise  ratio  defined  as  the  ratio  of  the  signal  energy  and  the  noise 
variance.  For  the  separable  signal  in  (6)  we  have 


After  appropriate  normalizations  to  render  the  bounds  dimensionless  we  obtain 


4SNR3 

9AS 


4SNR3  SNR' 
9A,  +  2  ’ 


1 


£) SNRl  + 


3SNR1 
4 


*  Derivation  of  the  bounds  is  given  in  Appendix  A. 


(22) 


(23) 

(24) 

(25) 
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Lotting  <7p  —  1  and  ac  =  \  (thus  o]  =  1.25),  and  at  =  and  A,  =  1  we  plot  the  bounds  of 
crr,  and  <7Ul  for  different  velocities  and  signal-io-noise  ratios  in  Fig.  3.  In  Fig,  4  we  plot  the 
bounds  for  different  A,,  setting  SNR  =  10  dB. 

We  observe  that 

1.  The  bounds  are  functions  of  SNR  as  well  as  A,  (or  equivalently,  A/\r). 

2.  The  bounds  (of  the  variances)  are  inversely  proportional  to  quadratic  functions 
of  SNR. 

3.  For  fixed  SNR  the  bounds  increase  monotonic&Uy  as  A*  increases.  This  property 
can  be  explained  by  observing  that  if  A,  increases  linearly  Ajv  must  increase 
quadratically  to  keep  SNR  constant. 

4.  All  bounds  are  independent  of  the  target  location. 

In  Fig.  5  we  have  plotted  a  few  typical  location  and  velocity  bounds  to  illustrate  the 
relationship  between  the  bounds  and  the  target  velocity.  It  can  be  verified  that  the  location 
bound  increases  monotonkally  between  V\  =s  0  and  Vi  s  oo  and  that  the  velocity  bound  has 
a  minimum  somewhere  in  the  interval  [O.7O7<r,/<rt,O.810<rj/<7t].  Thus,  as  a  design  criterion, 
<7,/<y,  should  be  chosen  in  the  vicinity  of  expected  target  velocity  -  the  classic  dwell-ln-cell 
criterion. 

In  appendix  B  we  have  included  formulas  for  the  numerical  computation  of  the  Cramer- 
Rao  bounds.  The  computed  Cram4r-Rao  bounds  have  similar  behaviors  as  those  discovered 
for  the  special  case  of  vq  s  0  discovered  in  the  section. 
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3  SUMMARY  AND  DISCUSSION 

For  a  moving  point  target  we  have  derived  the  Cramer-Rao  bounds  for  the  variance  of 
the  location  and  velocity  estimators.  The  major  difference  between  our  result  and  previously 

published  works  is  that  during  the  CCD  exposure  time,  the  target  streaks  and  the  velocity 
parameter  must  be  estimated  from  the  streak. 

To  compare  our  results  with  [3]  let  us  set  Vi  =  0  in  (A8).  The  location  bound  can  be 
rewritten  as 

2 Ji-  > 

<*\  (A./Aiv)3[2  +  9jr((r|  +  ^)AJV/A.]cr|  ‘  1  } 

If  we  fix  (Tc,  the  size  of  the  CCD  cells,  and  vary  <rp,  the  size  of  the  point-spread  function,  it 
can  be  shown  that  (26)  approaches  infinity  when  ap  approaches  either  zero  or  infinity,  and 
that  (26)  has  a  minimum  when  <re/<7p  is  in  the  vicinity  of  1.  Some  typical  curves  of  (26) 

are  plotted  on  the  left  hand  side  of  Fig.  6.  This  is  essentially  what  Is  shown  in  Fig.  2  of 

[3].  However,  we  notice  that  as  <rp  approaches  zero  both  sides  of  of  (26)  approach  Infinity 
regardless  of  the  value  of  That  is,  the  normalization  by  trjjj  masks  the  true  behavior 
of  the  bound  when  the  point-spread  function  becomes  infinitesimal.  A  more  interesting 
asymptotic  behavior,  however,  is  obtained  when  we  normalize  (AS)  differently,  namely 

>  T2t‘  (*} + m 
+  -  (V^)a[2  +  9T(<73  +  <r|)A^/Af]  1  ' 

The  right  hand  side  of  (27)  approaches  infinity  as  <xp  approaches  infinity,  but  it  approaches 

a  finite  value  when  <tp  approaches  zero.  Some  typical  curves  of  (27)  are  plotted  on  the  right 

hand  side  of  Fig.  6.  Intuitively,  if  the  point-spread  function  is  much  wider  than  the  CCD 

ceil  size  system  performance  suffers  because  we  must  look  at  many  noisy  pixels  in  order 

to  collect  most  of  the  signal  energy  in  the  spot.  On  the  other  hand,  if  the  point-spread 
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function  is  much  smaller  than  the  cell  size,  we  lose  subpixel  resolution,  and  therefore  the 


bound  asymptotically  approaches  a  finite  value. 
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APPENDICES 


A  THE  FISHER  INFORMATION  MATRIX  -  »  0 


To  evaluate  the  Fisher  information  matrix  we  must  find  the  derivatives  of  the  signal  function. 
In  the  special  case  that  vj*0  the  signal  is  given  by 


amn(xX)  v\)  “  Pl(xl  *“  *lmi  vl)  ^j(®3  ~  *3n)  t 


where 


Pl(xt  -  Xim,Vi)  a  —i 


and 


^(*3  -  *3n) 

The  derivatives  of  Eq.  (Al)  are 


\j2t{a]  +  t/Jcf )  *XP  I'feW) 
1 


i  exp 


(®3  -  ®2n)a 
~2?t 


(Al) 


(A2) 


(A3) 


famn 

dx\ 

d*mn 

6xi 

^Jmn 


’“'J  ,  *2™}Pl(xl  ~  xlm>Vl)Pl(x2  ~  ®2n)  i 

°t  +  v\at 

■-~-~2~"Pi(x\  —  *imi  vi)Pa(®3  x2n)  *  and 


(A4) 

(A5) 


pi 

ofTv Jcrf 


(*1  “  *lm)2 


-  1 


Pl(xl  “*lm»Vl)^»(*2  “  *3«)  •  (A0) 


L  *\  + 

In  the  following  we  assume  that  all  summations  can  be  replaced  by  corresponding  in¬ 
tegrals,  this  corresponds  to  the  limiting  case  of  small  detector  cells  and  large  focal  plane. 
Some  useful  summations  are 

2>*' -d»s*  ■ 

E^-^.E^-^.E^-^, 
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where  P,  x,  and  er 3  are  either  Pi(*i  -  Xim,t>i),  -  ^lmt  and  a]  +  u? of  or  P2{x2  -  ®2n)t 
xj  —  *2m  and  crj. 

The  energy  of  the  electronic  signal  is  given  by 

E  =  \]J2  P?(x  i  -  arm,,  v\)Pl  (*2  -  *a«) 

mn 


The  SNR  is  defined  to  be  the  ratio  of  signal  energy  and  noise  variance,  namely,  E/X^,  A 
justification  of  using  this  definition,  based  on  hypothesis  testing  theory,  is  given  in  Appendix 
C. 

We  now  derive  the  elements  of  the  Fisher  information  matrix.  Because  amn  and  dsmn/dv\ 
are  even  functions  in  m  and  n  and  8smnldx\  and  dsmn/Qx j  are  odd  functions  and  all  four 
functions  are  separable,  the  first  term  in  £q.  (18)  is  equal  to  zero  except  when  0,  =  0j  *  v1( 
the  second  and  the  third  terms  also  are  equal  to  zero  except  when  0<  *  9}  =>  xi  or  when 
0,'  a  0j  m  xj  or  when  0,-  *»  0j  «  Vi.  Therefore  all  of  the  off  diagonal  terms  of  the  Fisher  in¬ 
formation  matrix  are  equal  to  zero  and  the  diagonal  terms  are  given  by,  after  some  algebraic 
manipulation, 


U 


ii 


.  8A 


+  +  Z\ptT\J<rj  +  v\a^(T, 


4  9 


3)2 


(A10) 


lQ*3^  +  v?<r?)3ffj 

After  rewriting  fu,  fa,  and  fa  in  terms  of  SNR  we  conclude  that  the  Fisher  information 
matrix  for  the  special  case  that  v2  =  0  is 

o  (‘W1 +  »?»)£  o 


[(i  +  5J.)SNR’  +  3SNR](^): 

(All) 


B  FORMULAS  FOR  THE  COMPUTATION  OF  C-R  BOUNDS 


To  compute  the  Cramer- Rao  bounds  numerically  the  following  derivatives  of  (4)  are  needed: 


dsmn 

dx\ 

dSmn 

dxi 

damn 

6vi 


damn 
dv  2 


f  xi  -xim  [vi(a?t  ~  a?im)  4-  t>a(»a  -  «an)l  t>i  <r?  )  . 

I  *2  +  (u?  +  «$)*?  0!)  mn  ’ 

f  »a  -  *an  -  aim)  4-  va(*a  -  »an)]  «a 

I "7T"’  "  *2  +  (4  +  vM  °is  mn} 

f  «ig?  M*i -  xim)  4-  t>a(a>a  -  «an)l  (»i  -  a?im)  o} 

\  erf +  («}  ■+■  wj)<rj  ^  o)  +  (»}  +  vj)<rf  <rj 

[t>i(»t  -  aim)  +  va(«a  -  »an)l3  vi  <r<4 )  . 

W  +  («?  +  «S)*?la  *?J  mn  ’ 

f  ^  _  [vt(»i  -  »im)  +  vaCasa  -  «a»)](«a  ~  »an)  <r? 

l»2  +  ($  +  «JW  “  <rj  +  (v'i  +  viw 

[ui(»i  -  x\m)  +  va(*a  -  a?an)]a  va  g4 1  „ 

M  + <•?  +  «!)*?]■  ^Jmn’ 


(Bl) 

(B2) 


(B3) 


(B4) 


We  can  rewrite  (18)  as  an  explicit  function  of  SNR 


*“(£»)/(£*•)  ■ 
where  9\  m  x\,  0j  *  »j,  h  m  t>i>  and  O4  *  va. 
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C  THE  SNR  AS  A  PERFORMANCE  PARAMETER 


t 


In  this  appendix  we  relate  our  choice  of  SNR  to  a  hypothesis  testing  performance  parameter. 
Using  (9),  and  denoting  the  hypothesis  of  no  signal  present  by  Ho,  it  can  be  shown  that 


£[A|#o] 

£[Aa|tfo] 


*  1, 


-  n*[(i+ 

mn  l  ' 

* 

mn  \ 

-  n«p 


\  a  \ 

^>Jmn  A 

A/v  / 

l^*3m 


exp(-'2AJsmn) 


2A,jmn  +■  -  ^  j  exp(-2A,amri) 


(Cl) 


(C2) 


We  denote  the  distance  between  the  means  of  the  conditional  densities  p(A|Jfo)  and  p(A|.fl\) 
by  d.  The  d  is  commonly  used  to  characterize  the  test  performance  and  d2  is  given  by  (p.137, 
[5], [6]) 

d2  a  ln{l  +  VAR(A|ff0)}  ■  ln{jE7[Aa|^f0]>  .  (C3) 


Substituting  (C2)  into  (C3)  yields 

(C4) 

mn 

which  is  identical  to  our  definition  of  SNR. 
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Figure  3.  The  Cram4r-Rao  bounds(A,  m  1). 


Figure  4.  The  Cram4r-Rao  boundi(SNR  ■  10  dB). 
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